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Abstract 

In dynamical systems composed of interacting parts, conditional 
exponents, conditional exponent entropies and cylindrical entropies 
are shown to be well defined ergodic invariants which characterize 
the dynamical selforganization and statitical independence of the con- 
stituent parts. An example of interacting Bernoulli units is used to 
illustrate the nature of these invariants. 



1 Conditional exponents 

The notion of conditional Lyapunov exponents (originally called sub-Lyapunov 
exponents) was introduced by Pecora and Carroll in their study of synchro- 
nization of chaotic systems[l|] [@]. It turns out, as I will show below, that, 
like the full Lyapunov exponent, the conditional exponents are well defined 
ergodic invariants. Therefore they are reliable quantities to quantify the rela- 
tion of a global dynamical system to its constituent parts and to characterize 
dynamical selforganization. 

Given a dynamical system defined by a map f : M —>■ M , with M C 
R"^ the conditional exponents associated to the splitting x R"^~'^ are the 
eigenvalues of the limit 

lim {Dkr{x)Dknx))^ (1) 
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where D^f^ is the k x k diagonal block of the full Jacobian. 

Lemma. Existence of the conditional exponents as well defined ergodic 
invariants is guaranteed under the same conditions that establish the existence 
of the Lyapunov exponents 

Proof: Let /i be a probability measure in M C R"^ and / a measure- 
preserving M —>■ M mapping such that fi is ergodic. Oseledec's multiplicative 
ergodic theorem]^, generalized for non-invertible / [Q, states that if the map 
T : M — > Mm from M to the space of m x m matrices is measurable and 

J /i(rfx)log+||r(x)|| < oo (2) 

(with log"*" g = max (0, logg)) and if 

T: = T{f--'x)---T{fx)T{x) (3) 

then 

limjTrT^r- = (4) 

exists n almost everywhere. 

If Tx is the full Jacobian Df{x) and if Df{x) satisfies the integrability 
condition then the Lyapunov exponents exist /i— almost everywhere. But 
if the Jacobian satisfies (H), then the m x m matrix formed by the diagonal 
kxk and m—kxm—k blocks also satisfies the same condition and conditional 
exponents too are defined a. e.. Furthermore, under the same conditions as 
for Oseledec's theorem, the set of regular points is Borel of full measure and 

hm ilog||Ar(x)w|| =ef (5) 

with 7^ M G El/E^^^ , E^^ being the subspace of R'' spanned by eigenstates 
corresponding to eigenvalues < exp(,^|'^''). 

2 Conditional entropies and dynamical self- 
organization 

For measures /i that are absolutely continuous with respect to the Lebesgue 
measure of M or, more generally, for measures that are smooth along unstable 



2 



directions (SBR measures) Pesin's||] identity holds 

Hf,) = ^ A, (6) 

Ai>0 

relating Kolmogorov-Sinai entropy h{fi) to the sum of the Lyapunov expo- 
nents. By analogy we may define the conditional exponent entropies asso- 
ciated to the sphtting i?^ x R"^-'' as the sum of the positive conditional 
exponents counted with their multiplicity 

hkifi) = E d'^ (7) 

e^>o 

hm-M= E d™"'^ (8) 

The Kolmogorov-Sinai entropy of a dynamical system measures the rate of 
information production per unit time. That is, it gives the amount of ran- 
domness in the system that is not explained by the defining equations (or 
the minimal model Hence, the conditional exponent entropies may be 
interpreted as a measure of the randomness that would be present if the two 
parts S^^^ and S^"^~''^ were uncoupled. The difference hf:{fi) + hm-k{fJ') ~h{fi) 
represents the effect of the coupling. 

Given a dynamical system S composed of parts {Sk} with a total of 
m degrees of freedom and invariant measure /i, one defines a measure of 
dynamical selforganization I{S, S, fi) as 

N 

I{S, S, /i) = E {hkifJ') + /im-A:(/i) - Hfl)} (9) 
k=l 

Of course, for each system S, this quantity will depend on the partition S into 
parts that one considers. hm-k{fJ') always denotes the conditional exponent 
entropy of the complementar of the subsystem Sk- Being constructed out of 
ergodic invariants, /(S*, is also a well-defined ergodic invariant for the 
measure /i. I{S, is formally similar to a mutual information. However, 
not being strictly a mutual information, in the information theory sense, 
I{S, S, /i) may take negative values. 

Another ergodic invariant that may be associated to the splitting of a 
dynamical system into its constituent parts is the notion of cylindrical en- 
tropies. 
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Consider, as before, a yU— preserving and yU— ergodic mapping f : M ^ M 
and a splitting i?"* = x BJ^^^^. A measure in i?™ induces a measure in 

by 

v{x)^l di^{y,x) (10) 

a; e -R'^' and y G 7?™"''. 

Given a z/— measurable partition P[R^) in i?*^ 

i?'^ = yjiPi (11) 

Pj e P{R^) , it induces a partition in R^ by the associated cylinder sets 

R"^ = Uii^" (12) 

P^^PiX R"'-'' e P%R"'). 

Let P'=(M) = P''{R"') n M be the corresponding partition of M. Denote 
by P'^{x) the element of P'^{M) that contains x. If all powers of / are ergodic, 
for any nontrivial partition 

\imi,(P:ix))^0 (13) 

where 

P:i^) = n]^j-^{PV'{x))) (14) 

Then, the Shannon-MacMillan-Breiman theorem states that if 

E/^(^')M^')<oo (15) 

i 

the limit 

h%f, P^ x) = - lim - \ogpi{P:{x)) (16) 

exists fjL a. e. and converges in . This hmit is the entropy at x associated to 
the cylindrical partition P'^. The cylindrical entropy relative to the splitting 
R^ X R"^~^ may be defined as the integral of the supremum of this limit over 
all finite cylindrical partitions 

hV) = - I di^ix)snp lim - log ii{P^{x)) (17) 
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The full Kolmogorov- Sinai entropy is a similar limit where now the supre- 
mum would be taken over all finite partitions. Therefore for a smooth mea- 
sure, if the parts of a composite dynamical system are all uncoupled, the 
full entropy is simply the sum of the cylindrical entropies. In the uncoupled 
case each cylindrical entropy is determined by the corresponding conditional 
exponents. However for coupled mixing systems, the cylindrical partitions 
may, by themselves, already generate the full entropy of the coupled system. 
Therefore the relation of the cylindrical entropies to the total entropy is sim- 
ply a measure of the statistical independence of the constituent parts. The 
conditional exponent entropies defined in (0-H) seem to be a better quanti- 
tative characterization of the dynamical selforganization. 



3 An example 

Consider a fully coupled system defined by 

x,{t + 1) = (1 - c)f{xm + y: j^fMt)) (18) 

with f{x) = 2x (mod. 1). 

The Lyapunov exponents are Ai = log 2 and = log (2 (l - ]^c)) with 
multiplicity — 1. 

Therefore, for an absolutely continuous measure 



N-l 



h{fi) = log2 + (iV-l)log(2-^) for c< 
= log 2 for c > 



(19) 



2N 

The conditional exponents associated to the splitting x are 

= log(2 - 2c) (20) 

and 

d^-^) = log (2-^) ; ef"'^ = log (2-^) with multiplicity N 

(21) 

Therefore, for a partition E of the system with parts one obtains 

2Nc 



1(8, S, /i) = iV ( log ( 1 - + max (log(2 - 2c), 0) - max [\og [2 ^ _ ^ 

(22) 
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which in the hmit of large becomes 

I{S,T,,ij?) = ^ ^23) 

Fig.l shows the variation with c of I{S, for = 100. 

At c = 0, and starting from a random initial condition, the motion of 
the system is completely disorganized. When c starts to grow the system 
shows the coexistence of disorganized behavior with patches of synchronized 
clusters. At the point where I{S, E, //) is maximum, c = 0.495, starting from 
a random initial condition, the system settles rapidly in a state with many 
different synchronized clusters. Fig.2 shows the first 5000 time steps. It is 
indeed at this point that the system shows what intuitively we would call a 
large organizational structure. Above c = 0.5, after a short transition period, 
the system becomes fully synchronized (Fig. 3 for c = 0.51). 

4 Figure captions 

Fig.l - Coupling dependence of the selforganization invariant 7(5', E,/i) in 
the coupled Bernoulli system 

Fig.2 - The first 5000 time steps for c = 0.495 (maximum I{S, S, /x)). The 
last column in the right is the color map 

Fig.3 - The first 5000 time steps for c = 0.51 
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